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ABSTRACT 

Northern Arizona University's Arizona Career Ladder 
Research & Evaluation Project for teachers implements a procedure for 
rewarding teachers based on performance levels rather than on years 
of teaching experience and college credits. Research data is 
collected each spring, analyzed and fed back to the districts for 
improvement of key program components. This document is a data report 
representing descriptive and analytical results from a questionnaire 
administered to ten Phase I and Phase II pilot test districts. Data 
are presented in the following tables: (1) data return rate by 
districts and year; (2) demographics for the 1987 data cycle; (3) 
frequencies and percentages of selected demographics for 1986 and 
1987; (4) frequencies and percentages stratified on teacher career 
ladder participation and years of teaching experience; (5) means and 
change scores in perceptions of career ladder concepts; (6) composite 
mean perceptions for career ladder subscales by districts; (7,8,9,10 
and 11) response profile of percentage agreement with specific career 
ladder concepts based on comparisons among selected demographics; 
(12) organizational climate subscales stratified within selected 
demographic characteristics; and (13) educator perceptions of 
organizational climate items by percentage agreement/disagreement and 
total mean scores for 1986, 1987 data cycles. A brief evaluation 
summary and implications is presented for each table. Also included 
is the Executive Summary presented to the Arizona Joint Legislat s 
Committee on Career Ladders. Thirteen data tables, a letter to 
professional educators, demographic information sheet and a 
perception assessment scale conclude this document. (JD) 
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CENTER FOP EXCELLENCE IN EDUCATION 



October 15, 1987 

EXECUTIVE SUMMARY: The 1987 Preliminary Report To The Arizona 
Joint Legisbtive Committee On Career Ladders 



Overview 



In 1985, the Arizona Legislature esublished a five year career laddet pilot test program for teachers, under the 
direction of the Joint Legislative Committee on Career Ladders (JLCCL). The purpose of this pilot program is to 
implement a procedure for rewarding teachers based on performance levels rather than on their years of experience and 
college creditr. The program currently operates with fifteen districts; seven of the nine original districts who have 
implemented career ladder plans; three additional districts who started a year later and are now beginning the 
implementation phase; and five new districts who this year are developing their district plan for implementation next 
falL Research on, and evaluation of, the programs in all fifteen school districts is being conducted by the Center for 
Excellence in Education at NAU in cooperation with researchers from the UA and ASU. 



Research & Evaluation Methodolof^v 



The general program evaluation is designed as an improvement model. In order to enhance both the pilot models 
and teacher performance, research data is collected each spring, analyzed and fed back to the districts for i.nprovement 
of key program components. Each fall, dau results and evaluative observations are reported to the Joint Legislative 
Committee on Career Ladders for consideration and related decision making. By law, this process is to continue 
through 1989. 



ronrftpt<; rrtici'al to Procrram Rpfnrm 



Through a review of professional literature and examination of current trends in the United States, the project 
researchers have identified five areas which are crucial to program progress. (In the past, pro^raiiis like career ladders 
have failed due to a lack of attention to one or more of these categories). The program areas include: (I) Availability 
of adequate rg5?earrh A evahiarinn information for decision makers, (2) Presence of healthy levels of organizational 
climate within the work environment, (3) Willingness of teachers and professional organizations to suppon and 
participate in educational reform, (4) Commitment of adequate levels of fmanre & fnnHing with a balanced use of 
monetary and non monetary rewards and (5) Local awareness of the potential for substantive change and willingness 
to develop and adjust a program based on local resources, suppon and unique ciicumstances. 

Taking these five crucial areas into account, a district must seek answers to questions like the following in order 
develop a program with the best chances for impact and success: To what extent do the published points of view of 
teacher organizations impact on the way local teachers respond to program imtiations? Has there been adequate input 
from those affected? Is it inherently a teacher improvement and development program? Is the teacher evaluation 
instrumenution and process viewed as being fair and objective? Is teacher performance in relation to student academic 
achievement ^propriately assessed? Is there a balance between extrinsic and intrinsic rewards? 



Conection and Analv^i^ of Data 



Annually, each individual program participant is asked to fill in a questionnaire aimed at assessing individual 
perceptions of career ladder concepts (e.g., effectiveness, appropriateness, impact). A list of founeen demographic 
areas of comparison are shown on page 5 of the preliminary report- In addition to the types of questions which 
survey the concepts listed within the fourteen areas, participants respond to open-ended questions asking for general 
identification of program strengths and wealciesses. 
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Based on preliminary results, the program shows major trends as follows: Career ladder teachers suppon CL 
concept to a much higher degree than non CL teachers; greater amounts of experience are associated with lesser 
support fo- CL concepts; the greater amounts of inservice the greater the support for CL concepts; females support 
CL concepts to a much higher degree than do males; presence of perceptions of a healthy organizational climate are 
significantly related to appreciation of CL concepts; ethnicity is a factor in how "General CL Concepts" are viewed, 
e.g.s, in priority order, Asians, Blacks, Native Americans and Hispanics have a greater degree of agreement to CL 
concepts than do Whites; to a high degree, CL teachers are significantly more positive than non CL teachers in 
several areas, e.g.s, "attracts high quality people," "will improve instruction," "will i.-iprove student progress," and 
"time requirements are wonh benefits gained." The report to follow will show extreme differences among districts in 
levels of appreciation of CL concepts. 



Rfrommenriflfionc for IXTCL ron^Morntioti 

Based on three years of cooperative woric with districts, preliminary evaluation of research results, and ongoing 
review of programs throughout the country, the following recommendations are made: (1) Districts should be 
formally encouraged by the JLCCL to develop their own research base, (2) The JLCCL should formally recognize the 
newly developing district "network" as a means to dissiminate information for cooperative support and developm'^nt 
of district programs and to assist in the research and evaluation efforts for effective local change, (3) The JLCCL' 
should be aware that for the best teaching performance, career ladder programs may not be appropriate for all 
educators; this is due to variabilities in teacher characteristics, programs involving high levels of perceived 
competition and esublishment of specific degrees of staff differentiation, (4) The JLCCL should be cognizant of tnc 
fact that all teachers probably want to be accountable, and can be accounuble based on a standard district evaluation 
process, whether they are career ladder teachers or not, (5) It is important fcM" evaluative efforts within the programs to 
continue to study current trends which are showing that non career ladder and other categories of teachers are causing a 
decline of perceptions toward career ladder concepts, while their appreciation of the school environment in CL 
districts remains hif h, (6) Due to a limited amount of time for collection of appropriate research data, the recent 
addition of new districts to the program and the need for districts to ha/e more time to test their plans, the JLCCL 
should take steps to extend the career ladder project through 1990. For continuity, the program should remain under 
the jurisdiction of the JLCCL. 



Dr. Richard D. Packard, Projea Manager 
The Arizona Career Ladder Research & 
Evaluation Project 
Center for Excellence in Education 
Box 5774, Northern Arizona University 
RagsUff,Ajizona 86011 

Ph: (602) 526-5852 
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DESCRIPTIVE & ANALYTICAL RESULTS & EVALUATIVE SUMMARY 
FOR THE CAREER LADDER 1986 87 DATA CYCLES 
Dn Richard D. Packard, Project Manager 

On October 15, 1987. the RESEARCH & EVALUATTON: 1QR7 Preliminary Report for the Career T.adder 
Teacher Incentive and Development Program, was presented to the Joint Legislative Committee on Career Ladders 
(Packard, 1987). This document is a data report which basically substantiates those previous summary results. The 
material that follows, predominantly represents descriptive and analytical results from the ''Perception Assessment 
Scale," (Packard, R., A ,iamoni, L., Bierlein, L. & Helmsudter, G., 1986) administered to ten Phase I & Phase 11 
pilot test districts, for their yearly program evaluation cycle (see Exhibit A). The dau wii: be provided to each district 
for their own analysis and interpretation so that they may continue career ladder program improvements. 

District Da 1 Return Rate 

Table 1, describes data return rates for 1986 and 1987, by district code and amount of increase or decrease from the 
first to second year research cycles. An evaluative summary and implicaticns foKow the table. 

Table 1 

Data Return Rate by Disoia and Year 



District 1986 Returns 19F" Returns n Return Rate 











Increase 


01 


265% 


55.00% 


358/650 


+28.5 


02 


95.4% 


100.00% 


163/163 


+04.6 


03 


58i% 


77.90% 


60/77 


+ 19.4 


04 


65.8% 


32.40% 


88/272 




OS 


29.6% 


86.30% 


270/313 


+56.7 


06 


21.9% 


83.80% 


733/875 


+61.9 


07 


27.8% 


49.7C% 


358/720 


+21.9 


08 




63.10% 


65/103 




09 




52.20% 


1635/2992 




10 




67.20% 


121/180 




Total Return Rate 


46.5% 


66.76% 


3851/6345 


+20.3 
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Fvahifltivf Siimmflrv A Implications. The range of data returns was between 32.4% for district code 04 
to 100.0% for district code 02, with a total return rate of 66.76%. This represented an overall increase of 20.3% from 
the 1986 returns. In the future, for valid and reliable data analv , districts with returns under 70% may not remain 
under investigation utilizing research procedures which require survey questionriaire techniques. If they remain in the 
program, direct and on site observational techniques may be required. For the next evaluation cycle, the project is 
considering a differentiation of required return rates depending on whether the teacher is on a career ladder track or is a 
nonparticipant 

In the past, some districts have returned data forms in stapled and mutilated conditions. These types of data 
returns may not be analyzed u\ the future or may be returned to the district for correction of administraD procedures. 

Ppmoarflnhirs Fnr Tho 10R7 Data Cvrle 

Table 2, describes frequencies and percentages of sp&:ific demographic data related to project research interests. 
Specific areas depicted arc the following, (1) school level (2) type of position, (3) sex, (4) ethnicity, (5) degree esmed, 
(6) hours of inservice develc^ment, (7) teaching experience, (8) placement on the career ladder, (9) evaluative 
observations received, (10) position type conducting evaluative observations and ^ 1 ) administrative years of 
experience (see Table 2 on pages 9 through 10). 

Evaluative Summary & Tmplirations. There is a considerable diversity of individual characterisucs, 
conditions and experiences within career ladder districts. Many of these variables have been, and v^U continue to be, 
compared arul analyzed to describe, evaluate and improve career ladder program plans and activities. Implications are 
that district plans may be /ound to be successful even though there is a wide diversity in individual characteristics and 
program methodologies and procedures. 

Table 8, shows a considerable decrease in appreciation of career ladder concepts for those with greater teaching 
experience. Implications are that districts should be aware of the large percentage of teachers in the 8 to 15 year range, 
and study the reasons for some of the negative trends resulting from respondents in t!iis group. Also, the fact that 
close to 70% of the respondents report four or fewer hours of inservice education, is of great concern. Table 9, shows 
a much more positive response toward career ladders for those receiving five or moie hours of inservice development. 

FrequenciPfs & Percentages of Selected Demopraphitt For 1QS6 & 1987 Data Tvcles 

Table 3, depicts demographic trends by frequencies and percentages for both the 1986 and 1987 data cycles. 
Selected categories include level of employment, level of education, years of experience and amount of inservice 
development for teachers (see Table 3 on p . 1 ). 

Evaluative Summary and Tmplications . While there was a considerable increase in the number of 
individuals being studied, the percentage of those represented on the elementary and secondary levels of employment 
remained constant. There was a noticeable decrease in the percentage of individuals reporting a masters or greater level 
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of education and an increase in those with less than a masters degree. There was a considerable increase in the 
percentage of participants in the 8 - 15 ytm of experience categcHy, while there was a noticeable decrease in 
individuals receiving less than 5 hours of inservice related to general career ladder and evaluation procedures. 

FreqtiPnriiH; and Percentapes <;trafifipd on Teacher Cari^er f .ad der Partiripation & Yean; of 
Tt?aching Firperienpe 

Table 4, shows frequencies and percentages for 1987, stratified on the two characteristics of teacher career ladder 
participation and years of leaching experience. While Table 3, depicts similar data. Table 4, collipses years of 
teaching experience into the three categories of, 1 to 7, 8 to 25, and over 25, and consequentially, these were the strata 
which were cross compared in Table 8. Also, Table 4, adds the new category of career ladder participation. Some 
districts have already implemented their programs and others are just beginning the project, therefore, this results in 
three categories oi teacher participation in career ladder programs. These strata are, (1) Teachers who have been placed 
on the ladder - phase I districts, (2) Teachers who did not ^ply for the CLP - phase I and phase n districts, and (3) 
Teachers who applied, but were not placed due to the fact that (at the time of evaluation) their districts had not yet 
accomplished placement of teachers on die ladder - phase II districts (see Table 4 on page 12). 

Evaluative Summary & Implication^;. Over fifty percent of the teachers in career ladder districts have 
either applied for placement or have been placed on the career ladder prognmt Implicauons are that a majority of 
teachers in districts are interested in working with die career ladder reform movement Also, a majority of teachers in 
districts are shown to be in the 8 to 25 years of experience range. As previously stated, Table 8, shows teachers )/ the 
8 to 25 year category to be more negative toward career ladder concepts than those with fewer years of experience. 
Districts should be aware of this fact and attempt to address the implications. 

Means & Change Scor« in Pprr entions of CL Tonr Ppfs 

Table 5, depicts mean scores and increases or decreases in perceptions of career ladder concepts for 1986 and 198 / 
dau cycles. A mean and change score is shown for each specific item assessed on the "Perception Assessment Scale," 
along with the subtotals for each of the five career ladder components of, "General CL Concepts," "Suff Development 
& Training Concepts," "Teacher Evaluation System Concepts," "Peer Evaluation Concepts," and "Career Ladder 
Placement Concepts" (see Table 5 on pages 13 through 14). 

Evaluative Siimmar v & Tm plications. The greatest amounts of increase in perceptions of career ladder 
concepts from 1986 to 1987 were observed in the areas of, "Money Awards Available" (+.439), "Intrinsic Rewards 
Available" (+.362), "Administrators Evaluate Fairly" (+.152), and "Teachers Have Enough Selection Input For Peer 
Evaluators" (+256). The greatest amounts of decrease were shown in, "Retains Most Competent People" (-.310), 
"Will Improve Instruction" (-.229), "Will Impro/e Teacher Mor^p" (-.505), "Will Improve Perceived Professional 
Status" (-.267), "Time Evaluators Spent Observing Teachers Is Sufficient To Ensure Proper Placement On The 
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Ladder" (-.173), "Peer Evaluators Are Well Trained" (-,225), "Peer Evaluation Is Used Fomiatively" (-.336), "Staff 
Cooperation Is Encouraged" (-,509), and "Teachers Are Adequately Involved In Ti^ Development Of The District 
Career Ladder Progiam" (-,254), 

In mean scores, the most positive agreement for career ladder concepts are in the areas of, "Monetary Awards 
Available" (2,764), "The District Provides Adequate Resources For Teaching Sldll Development" (2,578), "TTie 
Evaluation Instruments Clearly Define The Various Levels of Teaching Performance" (2.589), "Administrators 
Evaluate Teaching Performance Fairly" (2,624), "The CLP Provided Teachers With Opportunities foe Continued 
Advancement" (2,633) and "Tc^ Level Responsibilities Are Appropriate" (2,530), The five most negative area^? are, 
"Retains Fhe Most Competent People" (2,094), "Student Outcomes Reflect Performance" (2,054), "Teachers Have 
Enough Peer E valuator Selection Input" (2,072), "Peer Evaluation Improves Staff Cooperation" (2,049), and "Clear 
Criteria For Program Participation Have Been Established For Personnel Whose Job Description Differs From A 
Regular Oassroom Teacher" (2,004). 

At the time of the evaluation, inq)lications were that, overall trends were slighdy toward the negative end of the 
scale, but there are also positive trends in some areas assumed to be key to program success. For example, literature 
has indicated that a major reason for program failures in the past was due to the lack of confidence in administrators' 
capabilities to evaluate fairly and objectively. This category of the study shows mean confidence levels of 
"administrators evaluate fairly," to have positively changed from a score of 2,475 to 2,624, thereby, moving from the 
disagree side of the scale to the agree side. 

Composite Mean Pprrpptinns For Parff r I/irfder f;iih<;pales h v District 

Table 6, shows con^ite mean perceptions on seven career ladder subscales for ten pilot districts. The specific 
career ladder concept conponenis of GEN, STF, TEV, etc., are spelled out by the key immediately following the 
table. Also shown, are the range and median scores for each component (see Table 6 on page 15). 

Evaluative Nummary & Tmnlicafinns. Among many evaluative sutements which can be made as a result 
of the descriptive data shown in Table 6, the following are rejM^entative examples: (1) The greatest range differences 
from low to high scores appear in the areas of "Staff Development and Training Concepts" (STF) ^d "Peer Evaluation 
Concepts" (PEV), (2) In "Staff Development and Training Concepts," district 03 was low with a mean score of 2,05 
and district 04 was high with a score of 2.98, (3) While there was a wide range in the area of "Peer Evaluation 
Concepts," the only districts who could gain from evaluative review would be those which are actually utilizing peer 
evaluators, (4) In reviewing career ladder components in columns the two highest mean scores are shown in the areas 
of "Organizational Climate" and "Staff Development and Training Concepts," (5) In reviewing rows, districts 02, 05, 
06, 04, 08 and 01 with a range from 2.76 to 2.48 show the highest mean scores, and districts 03, 09, 07 and 10 (with 
a range from 2,20 to 2.36) show the lowest mean scores. 

Implications are that there is a wide range oi differences among districts in the way professionals view career 
ladder concepts. Districts are advised to review their own scores and the specific career ladder concepts being assessed 
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within each of the major components (GEN. STF. etc.) and atten^t to improve low scores. Also, districts with low 
scores may heed to communicate with those in the high range to evaiuate effective approaches for program 
improvement Work with the newly organized "Arizona Career Ladder Network" may be anotfier means to secure 
assistance for program development 

Pi^cpon^P Profilp nf Pprcentapp At^repmP fit With Snecinr C^n^Pr Ladder ConceDtS Baspiim 
f niiipari«>nn<i Amonp SelprfpH Demographics 

Tables 7, 8, 9, 10 and 11, show percentages of agreement with career ladder concepts based on comparisons of 
stratified demographic characteristics of interest The following is a listing of areas of comparison between or among 
selected variables: 

Percentage comparisons are ihown betv^een or among the following characteristics: 

L Table 7 - Texhers placed on the career ladder, nonparticipants and those who have applied or intend to 
apply but have not yet been placed (see Table 7 on pages 16 through 21 ). 

2. Table 8 - \ -^ars of experience based on 1-7, 8 -25 and Over 25 (see Table 8 on pages 22 through 27). 

3. Table 9 - Hours of inservice development, based on 0 to 4 hours, and 5 or more (see Table 9 on pages 

28 through 33). 

4. Table 10- School level, based one elementary, middle sch x-l/junior high and high school (see Table 10 

on pages 34 t*^'^ugh 39). 

5. Table 1 1- JoJ .ype, based on whether the respondent was an administrator or teacher (see Table 1 1 on 

pages 40 through 45). 
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pvahiative Summary & Implications. While Ubles for tests of significance between and among the 
several variables of interest are not shown in this document, in actuality, Chi Square sutistical treatment of data 
resulted in high levels of significance for all comparisons. By viewing the percentages for each tabic, one can readily 
see Ae extreme diversity in agreement or disagreement to career ladder concepts, when compared on specific 
demographic characteristics* 

Jable 7. shows an extreme difference in agreement with career ladder concepts among those teachers on the 
ladder, nonparUcipants in the program and those applying, but not yet placed. In many -ases, there was a m .ge from 
20 to 30 percentage points between teachers on the ladder and nonparticipants, with those not parJcipating usually 
quite negative about program concepts, while participants were found to normally be very positive. Implication- 
were, that the slightly negative trends from 1986 to 1987 dau can largely be attributed to nonparticipants. 

There are some interesting observations to be made in relation to some of the specific career ladder concepts. A 
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list of some examples are: Regardless of participation status, (1) teachers did not believe career ladder programs would 
encourage teacher cooperation and improve teacher morale, (2) tliey didn't feel they had adequate input into selection of 
peer evaluators, (3) adequate assistance was not seen to have been available which would have provided teachers 
information and support regarding development of materials submitted for evaluation, (4) clear criteria for career ladder 
participation was perceived to not have been established for personnel whose job descriptions differ from a regular 
classroom teacher. 

Regardless of participation, teachers felt monetary rewards were available and administrator and peer evaluators 
were weU trained. Perceptions of support resources for developing teaching skiUs were very positive and teachers felt 
the evaluation instruments clearly defined the various levels of teaching performance. Most agreed that administrators 
evaluated fairly and that eviluators were trained weU. The majority agreed that there was a fair appeal process and the 
program provided opportunities for continued advancement without leaving the classroom. 

labkJ. shows extreme differences in agreement with career ladder concepts based on number of years of 
experience. Fewer years of experience in teaching was related to a much higher appreciation for career ladder concepts. 
If this trend continues to hold true through the total pilot test, impUcations are that during program implementation 
phases, teachers with greater amounts of experience may not have a motivational advantage in moving into the career 
ladder program. 

T a Mf 9. depicts significant differences in agreement with career ladder concep"^ based on numbers of hours of 
inservice development. For 38 out of 40 career ladder concepts assessed, those teachers receiving five or more hours of 
inservice development were significantly more positive about program components than those reporting four or fewer 
hours of inservice development 

Implications are that greater amounts of inservice activities are clearly more advantageous to program 
development Tor plans experiencing difficulties, it would be advisable to institute corrective i.;?asures that address 
communication and inservice education. 

T a Mf 1ft . shows some differences in agreement with career ladder concepts based on school level. Elementary 
and middle school/junior high school levels were consistantly more positive toward career ladder concepts than high 
school teachers, although, the differences were not extensive. 

Implications are that teacher job levels of elementary, middle/junior high and high school, may not be a major 
problem in positive implementation of career ladder programs. 

T a Mf 11 . depicts significant differences between administrator and teacher agreement with career ladder concepts. 
AdministratOTS were significantly more positive about career ladder programs than were teachers. 

In the future, the effect this condition wiU have on program development is not known. One possible association 
to be studied relates to the fact that the organizational climate section of the research data indicates that teachers felt 
they have good leadership models. It wiU be important to see if the highly positive perceptions of career lad-'er leaders 
will influence teacher perceptions of program components in the future. 
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Orrp.niyiational Climate Suhscales Stratified within Sele c ted Ppmo^raphic rhararteristi tH; 

Table 12, depicts means of organizational climate for seiccted and stratified demographic characteristics on the 
subscales of, ''General Career Ladder Concepts," "Staff Development and Training Concepts," "Teacher Evaluation 
System Concepts," "Peer Evaluation Concepts," and "Career Ladder Placement Concepts." The table also shows the 
grand means for the stratified demographic variables and subscales, the composite means for subscales, and the 
composite grand mean (see Table 12 on page 46). 

Evaliiativp Snmmarv & Tmpliration<;. Briefiy, the subscale and grand means show the following kinds of 
results in relation to stratified demographic characteristics: (1 ) Teachers who had applied foe the CLP and those who 
had appl J and been placed on the ladder had a higher regard for their woridng environment than those who did not 
apply for the program, (2) Teacher^ with greater amounts of teaching experience had a lower regard for their working 
environment, (3) Administrators lad a higher regard for their working environment than did teachers, and (4) 
Elementary and secondary teachers were very similar • perceptions of the working environment. Composite 
means pooled across demog-iphics were generally very high with the exception of "General Career Ladder Concepts." 

Implications are that while teacher and administrator perceptions are generally very high in regard to 
organizational climate, the specific concepts of, "Encourages Teacher Morale," and "Encourages Teacher Cooperation," 
within the "General Career Ladder Subscale," have a considerable negative effect on total perception scores. 

Educator Percentions ot Orpani/afional r!imati> TtPms hv Percentage Agreemp nt. Disa^reempiif 
and Total Mean Seore^ for 10Kr>. Data Cvc\9^ 

Table 13, shows teacher and administrator perceptions of specific organizational climate items by percentages of 
respondents who .strongly agree (SA), Mildly Agree (MA), Mildly Disagree (MD), and Strongly Disagree (SD), and 
including total mean scores for the i986, 1987 data cycles (see Table 13 on page 47). 

Evaluative Summary & Tmnlication*;. Since adjuc'ments were made in the "Oganizational Climate" 
items from 1986 to 1987, total co.. parisons are difficult. There are some item areas which show variations of note. 
For examples, between areas of extremely high support and those with lessor support, the following components have 
been dichotomized and listed: 

Extremely high rated components were, 

1. "I feel by work has clear purpose." 

2. "I have feelings of being successful in my job assigmnent." 

3. "I feel my job has functional importance to the organization." 

4. "I feel secure about my job status." 

5. "I am provided a cooperative work environment" 
The 5 lowest rated components were, 

1. "I work in an environment free from excessive stress." 



2. "I have a feeling of being rewarded for a job well doi.*-." 

3. "I feel good about the communication level in my organization " 

4. "I am consistently provided knowledge of progress/ 

5. "I feel there is a strong social network in my organization," 

Implications ar^ *spcndenis feel \tiy good about themselves, their work and success in carrying out 
professional respo. ^es. They felt less good about levels of stress, rewards for their work, organizational 
communication (a factor of communication is knowing if they are making progress or not), and feelings related to 
social interrelationships. In general, teach ,rs felt they were "provided a cooperative woii environment," but they did 
not believe the career ladder program "encourages cooperation among teachers." 
C inclusion 

For future development of career ladder plans, pilot districts should become aware of ^he descriptive and analytical 
results, evaluative summarys and implications contained in the narraUvg and tables of this document 
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Table 2 

Demographics Across Total School District 
Arizona Career Ladder Projects 
For 1987 Data Cycle 



SCHOOL LEVEL WORKED 

Elementary 2089 54.2% 

Middle/Junior High 758 19.7% 

High School 948 24.6% 

DNA 40 1.0% 

0 16 .5% 



POSITION IN DISTRICT 

Teacher 3223 

Libranan 76 

Counselor 77 

Other Resource 360 

Bdlg. Administrator 79 

Central Office Admins. 25 

0 11 



83.7% 
2.0% 
2.0% 
9.3% 
2.1% 
.6% 
.3% 



Total 



3851 



100.0% 



Total 



3851 



100.0% 



RESPONDENT'S GENDER 



Female 

Male 

0 



2709 
1033 
109 



70.3% 
26.8% 
2.8% 



RESPONDENT'S ETHNICITY 

Anglo 3265 84.8% 

Hispanic 197 5.1% 

Native American 112 2.9% 

Black 30 .8% 

Asian 32 .8% 

Other 57 1.5% 

0 158 4.1% 



Total 



3851 



100.0% 



Total 



3851 



100.0% 



DEGREE EARNED 

Bachelors 498 12.9% 

BA+ 1541 40.0% 

Masters 374 9.7% 

Masters 1366 35.5% 

Doctorate 49 1.3% 

0 23 .6% 



HOURS DISTRICT INSERVICE 



0 - Hours 

1 - 4 Hours 
5 - 8 Hours 
9 - 12 Hours 
13+ Hours 
0 



1474 
1140 
296 
131 
557 
253 



38.3% 
29.6% 
7.7% 
3.4% 
14.5% 
6.6% 



Total 



3851 



100.0% 



Total 



3851 



100.0% 
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Table 2 (Continued^ 



YEARS TOTAL AS TEACHER 



BEEN PLACED ON CLP 



1-3 
4-7 
8-15 



Yeare 
Yeare 
Yeare 



16-25 Yeare 



25+ 
0 



Yeare 



613 
734 
1502 
694 
193 

lis 



15.9% 
19.1% 
39.0% 
18.0% 
5.0% 
3.0% 



Yes 

No 

No Placement 
0 



1048 
2126 
531 
146 



27.2% 
55.2% 
13.8% 
3.8% 



TOTAL 



3851 



100.0% 



TOTAL 



3851 100.0% 



MLL APPLY FOR CLP 



NUMBER OBSERVATIONS RECEIVED 



Yes 


962 


25.0% 


c 


1722 


44.7% 


No 


1589 


41.3% 


1 - 3 


919 


23.0% 


DNA 


1043 


27.1% 


4-6 


302 


7.8% 


0 


257 


6.7% 


7 9 


177 


4.6% 








10+ 


474 


12.3% 








DNA 


21 


.5% 








0 


236 


6.1% 


TOTAL 


3851 


100.0% 


TOTAL 


3851 


100.0% 


WHO CONDUCTED OBSERVATIONS 


YEARS AS 


ADMINISTRATORS 


Only Bldg Admin. 


1084 


28.1% 


3, Or Less 


61 


1.6% 


Bldg. Admin. & Peer 


241 


6.3% 


3 - 7 Years 


53 


1.4% 


Bldg. & Cent. Office 


124 


3.2% 


8 - 15 Years 


48 


1.2% 


Bldg. , Cent., & Peer 


87 


2.3% 


16-25 Years 


28 


.7% 


Other Combinations 


135 


3.5% 


Over 25 Years 


41 


1.1% 


DNA 


1176 


30.5% 


0 


3620 


94.0% 


0 


1004 


26.1% 








TOTAL 


3851 


100.0% 


TOTAL 


3851 


100.0% 
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Table 3 

Selected Demographic Trends For 1986 & 1987 Data Cvcles 
> — ■ 



! 


1986 


1"87 


i^CvCl UI L^IU p 1 U\ in C 11 1 






Elemementary level educators 


1439 (lA 


^OH / \ / j.y /o) 


Secondary 


464 (23.9%) 


948 (24.6%) 








Masters degree or higher 


849 (55.2%) 


1789 (46,5%) 


Indicated less than a masters degree 


1044 (44,8%) 


2039 (52.9%) 


Years of Teaching Experience (teachers) 
1986 Categories 1987 Caiegories 






UnderS years 1 - 3 years 


.78 (19,5%) 


613 (15,9%) 


3 - 7 years 4 - 7 years 


446 (23,0%) 


734 (19.1%) 


8 -15 years 8 -15 years 


586 (29.4%) 


1502 (39,0%) 


16 -25 years 16 -25 years 


312 (16.1%) 


694 (18.0%) 


over 25 years over 25 years 


47 (2.4%) 


193 ( 5.0%) 


Teacher Inservice on CLP 
(procedures and evaluation) 






Teachers receiving between 0 - 4 hours 


1480 (76.5%) 


2614 (67,9%) 


Teachers receiving between 5 - 12 hours 


164 ( 8.4%) 


427 (10.1%) 


Teachers receinng 1 3 or more hours 


127 (6.6%) 


253 ( 6.6%) 
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Table 4 

Composite Frequencies & Percentages 
by Selected Demographic Characteristics 
for the 1987 Data Cjcle 





FREQUENCY 


PERCENT 








Teachers who applied for CLP, but not yet placed 


962 


(25.0%) 


Teachers who did not apply for GLP 


1589 


(41.3%) 


Teachers who are placed 


1043 


(27.1%) 


1-7 years teaching experience 


1347 


(33.0%) 


8-25 years teaching experience 


2196 


(57.0%) 


Over 25 years teaching experience 


193 


( 5.0%) 
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Tables 

Means & Change Scores in Perceptions 



of Career Ladder Concepts for 1986-87 Data Cycles 







Directional Change 


1986 Mean 


Increase Decrease 



GENERAL CAREER LADDER CONCEPTS 



14 


Attract High Quality People 


2.435 


2.264 




.171 


15 


Reuin Most Competent People 


2.404 


2.094 




.310 


16 


Will Improve Instruction 


2.568* 


2.339 




.229 


17 


^'tudent Progress Improvement 


2.396 


2.220 




.176 


18 


£ncourage Teacher Cooperation 


2.015- 


1.887- 




.128 


19 


Improve Teacher McHale 


2.273 


1.768- 




505 


20 


Improve Perceived Professional Status 


2.620* 


2.353 




.267 


21 


Money Rewards Available 


2.325 


2.764* 


.43? 




22 


Intrinsic Rewards Available 


1.808- 


2.170 


.362 




23 


Goals Clearly Communicated 


2.475 


2.438 




.037 




Means and Changes Subtotals 


2.332 


2.230 




.102 



STAFF DEVELOPMENT & TRAINING CONCEPTS 

24 Received Adequate Inservice 2.317 2.356 .039 

25 Administratore Well Trained 2.478 2.4 19 .059 

26 Peer EvaluaUH^ Well Trained 2.373 2.331 ,042 

27 Adequate Teacher Skills Resources 2.561* 2.578* .017 



Means and Changes Subtotals 



2.432 2.421 .011 



TEACHER EVALUATION SYSTEM CONCEPTS 



28 


Performance Levels Qearly Indicated 


2.607* 


2.589* 




.018 


29 


Administrators Evaluate Fairly 


2.472 


2.624* 


.152 




30 


Consistent Evaluation Procedures 


2.285 


2.253 




.032 


31 


EvaluaticHi Time Sufficient 


2.594* 


2.421 




.173 


32 


Time Worth Benefits gained 


2.317 


2.153 




.164 


33 


Right Achievement Emphasis 




2.401 






34 


Student Outcomes Reflect Performance 




2.054 








Means and Changes Subtotals 


2.455 


2.356 




.099 
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Table 5 (Continued) 



1986 Mean 1987 Mean 



Directional Change 
Increase Decrease 



PEER EVALUATION CONCEPTS 



35 


Chosen For Top Qualifications 


2.325 


2.140 




.185 


36 


Well Trained Evaluators 


2.666* 


2.441 




.225 


37 


Teachers Have Enough Selection Input 


1.816- 


'..07? 


.256 




38 


Peer Evaluation Used Formatively 


2.618* 


2.282 


.336 


39 


Peer Evaluation Used Sununatively 


2.479 


2.292 




.187 


40 


Staff Coc^ieration Encouraged 


2.558* 


2.049- 




.509 




Means and Changes Subtotals 


2.410 


2.213 




.197 



CAREER LADDER PLACEMENT CONCEPTS 



41 


Fair Appeal Process 


2.485 


2.461 


.064 


.024 


42 


Advance Criteria Understood 


2.352 


2.416 




43 


Can Stay At Same Level 


2.419 


2.494 


.075 




44 


Challenging CLP Criteria 


2.309 


2.158 


.055 


.151 


45 


Evaluation Materials Standards - Criteria Clear 


2.389 


2.444 




46 


Adeuqate Help for Evaluation Materials 


2.220 


2.298 


.078 




47 


Opportunities For Advancement 


2.657* 


2.633* 




.024 


48 


Adequate Teacher Involvement 


2.704* 


2.450 




.254 


49 


Net Positive Benefits of Top Responsibility 


2.418 


2.265 




.153 


50 


Clear Personnel Criteria 


2.047- 


2.004- 




.043 


51 


Top Responsibilities Appropriate 


2.625* 


2.530 




.095 


52 


Enough Trained Personnel 


2.404 


2.361 




.043 


53 


Teacher Input On Revisions 


2.450 


2.348 




.102 




Means and Changes Subtotals 


2.421 


2.374 




.047 




TOTAL MEANS 


2.410 


2.319 




.094 



#MEAN - Range = 1.000 - 4.000 
(*) depicts means in positive range 



Values from 1.000 - 2.500 « Generally Negative 
Values from 2.501 - 4.000 = Generally Positive 
(-) depicts means in extreme negative range 
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Table 6 

Composite feans and Totals by District 
and Career Ladder Subscales 



DISTRICT 


GEN STF 


TEV 


PEV 


CLP 


CLM 


STU TOTAL 


A1 
Ul 


2.32 


2.56 


2.36 


2.30 


2.38 


2.95 


2.03 


2.48 


U2 


2.66 


2.94 


2.72 


2.69 


2.62 


2.92 


2.46 


2.76 


ni 
Uj 


2.05 


2.05 


2.07 


2.25 


2.25 


2.57 


2.20 


2.20 


04 


2.17 


2.98 


2.45 


2.69 


2.37 


2.95 


2.22 


2.60 


05 


2.51 


2.76 


2.71 


2.48 


2.60 


? OR 


2.53 


2.67 


06 


2.32 


2.70 


2.53 


2.48 


2.61 


3.11 


3.41 


2.63 


07 


2.15 


2.22 


2.30 


2.13 


2.20 


2.81 


2.32 


2.30 


08 




2.66 


2.70 


1.98 


2.65 


2.92 


2.49 


2.56 


09 


2.07 


2.09 


2.10 


2.01 


2.21 


3.05 


2.02 


2.25 


10 


248 


2.23 


2.44 


2.06 


2.31 




2.51 


2.36 


Total Means 


2.32 


2.52 


2.44 


2.31 


2.42 


2.89 


2.42 


2.48 


CL COMPONENTS 








RANGE 




MEDIAN 


GEN 


General Career Ladder Concepts 


2.05 - 2.66 




2.32 




STF 


-• Staff Development Concepts 


2.05 - 2.98 




2.61 




TEV 


■ Teacher Evaluations Concepts 


2.07 - 2.72 




2.45 




PEV 


■ Peer Evaluations Concepts 




1.98-2.69 




2.28 




CLP 


Career Ladder Placement Concepts 


2.20 - 2.65 




2.38 




CLM 


School Climate Concepts 




2.57 - 3.11 




2.94 




STU 


Student Achievement Concepts 


2.02 - 2.53 




2.37 




TOTAL -- 


Average Score by District 




2.20 - 2.76 




2.52 
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Table? 



Response Profile of Percentage Agree with Specific 
Research Components by Career Ladder Participation 



= Already placed on career ladder 



■■ Nonparticipant 



Item 



PERCENTAGE AGREE 
0 10 20 30 40 50 60 70 



' = Applied - Not Placea 



80 



90 100 



GENERAL CAREER LADDER CONCEPTS 
14 Attracts high quality pec^le 



L 



60.7% 
37.2% 
51.4% 



15 Retain most coitq)etent people 



L 




51.5% 
29.3% 
43.5% 



16 Will improve instruction 




71.6% 
42.4% 
55.2% 



17 Student progress improve 



63.3% 
37.9% 
52.5% 



18 Encourage teacher cooperation 




43.1% 

24.3% 
42.3% 



19 Improve teacher morale 




28.5% 
18.4% 
27.9% 



20 Improve perceived professional status 




61.3% 
41.1% 

53.5% 



ERIC 
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Table 7 (Continued) 



10 



20 



30 



PERCENTAGE AGREE 
40 50 60 70 



80 



90 



100 



Item 

GENERAL CAREER LADDER CONCEPTS (continued) 
21 Money rewards available 



71.5% 
66.2% 
75.0% 



22 Intrinsic reward available 



51.8% 
33.7% 
42.7% 



23 Goals clearly conununicated 



51.6% 
53.1% 
53.2% 



STAFF DEVELOPMENT AND TRAINING CONCEPTS 
24 Recieved adequate inservice 







1 




25 Administrators well trained 
















1 



64.0% 
46.0% 
52.2% 



66.3% 
56 6% 
64.6% 



26 Peer evaluators well trained 















1 



59.5% 
59.9% 
75.5% 



27 Adequate teacher skills resources 



17 



66.6% 
56.9% 
58.4% 
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Table? (Continued) 





0 


10 


20 


30 


PERCENTAGE AGREE 
40 SO 60 


70 


80 


90 


100 



Item 



TEACHER EVALUATION SYSTEM CONCEPTS 
28 Performance levels clearly defined 



10.1% 



29 Administrators evaluate faiily 




12.1% 
51.9% 
66.3% 



30 Consistent evaluation procedures 



54.4% 
42.9% 
54.0% 



31 Evaluation time sufficient 




64.3% 
48.0% 
60.9% 



32 Hme woith benefits gained 




58.8% 
.18.6% 
50.0% 



33 Coirea achievement en^hasis 



69.3% 
39.4% 
57.3% 



34 Student outcomes reflect performance 



50.1% 

28.2% 
47.8% 
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Table 7 (Conanued) 



10 



20 



30 



PERCENTAGE AGREE 
40 50 60 70 



80 



90 



100 



Item 

PEER EVALUATION CONCEPTS 
35 Chosen for top performance 



54.8% 
48.6% 
58.3% 



36 Well trained evaluators 



















L_ 1 



66.7% 
64.7% 
77.5% 



37 Teachers have enough selection input 




38 Peer evaluations used formatively 



29.2% 
29.4% 
27.0% 



68.0% 
45.0% 




39 Peer evaluations used sumnuuively 

40 Staff cooperation encouraged 



27.9% 
44.3% 
47.1% 



60.4% 
41.7% 
59.5% 
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Table 7 (Continued) 













PERCENTAGE AGREE 










0 


10 


20 


30 


40 50 60 


70 


80 


90 


100 



Item 



CAREER LADDER P'.ACMENT CONCEPTS 
41 Fair appeal process 




64.8% 
51.7% 
66.7% 



42 Advancement criteria understood 



57.8% 
55.8% 



43 Can stay at same level 



61.9% 
58.0% 
65.8% 



44 Challenging CLP criteria 




56.2% 
32.0% 
41.2% 



45 Clear evaluation standards 



46 Adequate materials assistance 



56.2% 
53.0% 



47.0% 
40.9% 



47 Outside advancement opportunities 





























1 





72.6% 
58.7% 
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Tablc7(Connnued) 



Item 





0 


10 


20 


30 


PERCENTAGE AGREE 
40 SO 60 


70 


80 


90 


100 



CAREER LADDER PLACEMENT (continued) 
48 Teachers involved in CLP development 



56.5% 
52.0% 
55.1% 



49 Net positive response for greater 




57.3% 
38.7% 
59.0% 



SO Qear personnel criteria 




39.6% 
34.3% 
32.4% 



SI Higher responsibiiides appropriate 




70.5% 
51.9% 
67.1% 



S2 Adequate number of trained personnel 







1 








1 



56.8% 
46.3% 
61.7% 



S3 Adequate teacher input on revisions 













1 1 
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Table 8 



Response Pronie Of Percentage Agree 
With Specific Research Components By Years Of Experience 



= 1-7 yrs. teaching exp. 



= 8-25 yrs. teaching exp. 



i: 



= over 25 yrs. teaching exp. 



10 



20 



30 



PERCENTAGE AGREE 
40 50 60 70 



80 



90 100 



Item 



GENERAL CAREER LADDER CONCEPTS 
14 Attracts high quality peq)le 




56.8% 
40.2% 
28.8% 



IS Retain most coiq)etent people 




47.2% 
30.7% 
25.8% 



16 Will improve instruction 




60.0% 
43.9% 
33.5% 



17 Student progress improve 



53.3% 
38.0% 
31.0% 



18 Encourage, teacher cooperation 



llllllllllllllllllllllllllllllllllllllllllllllllillllllllllllllll 



34.9% 
23.1% 
18.1% 



19 Improve teacher morale 




29.6% 
17.7% 
14.3% 



20 Improve perceived professional status 



iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiitfiiiiiiiiiiiiiiiiiiiiiiiiiiiiii 



56.3% 
43.8% 
33.3% 
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Tables (Continued) 



PERCENTAGE AGREE 



10 



20 



30 



40 



50 



60 



70 



80 



90 100 



Item 



GENERAL CAREER LADDER CONCEPTS (continued) 
21 Money rewards available 



75.1% 
59.6% 
58.4% 



22 Intrinsic reward available 




4«?.9% 
34.5% 
32.7% 



23 Goals clearly communicated 




50.5% 
52.4% 
48.6% 



STAFF DEVELOPMENT AND TRAINING CONCEPTS 
24 Recieved adequate inservice 



L 



43.9% 
47.2% 
57.3% 



2S Administrators well trained 

81 




55.2% 
48.1% 
38.8% 



26 Peer evaluators well trained 



^."-.v-> -.'jy.>. 



'iiiiiiiHMiii'iiiiiiiiiii mill 



51.5% 
43.9% 
38.2% 



27 Adequate teacher skills resources 



23 



62.5% 
57.6% 

53.3% 
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Tables (Continued) 



10 



20 



PERCENTAGE AGREE 
30 40 50 60 70 



80 



90 100 



Item 



TEACHER EVALUATION SYSTEM CONCEPTS 
28 Perfonnancc levels clearly defined 




61.5% 
57.6% 
53.1% 



29 Administrators evaluate fairly 




69.0% 
57.7% 
48.4% 



30 Consistent evaluation procedures 




49.7% 
41.4% 
39.2% 



31 Evaluation time sufficient 




54.1% 
46.8% 
45.2% 



32 Time worth benerlts gained 




50.3% 
34.1% 
33.1% 



33 Correct achievement emphasis 



iiiiiiiiiiiimiiiiiiii 



62.2% 
46.5% 
42.4% 



34 Student outcomes reflect performance 




43.0% 
30.6% 
32.0% 
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Tables (Conunued) 



PERCENTAGE AGREE 
0 10 20 30 40 SO 60 70 



80 



90 100 



Item 



PEER EVALUATION CONCEPTS 
35 Chosen for tq) performance 



50.1% 
37.2% 
19.6% 



36 Well trained evaluators 



57.8% 
50.1% 
39.7% 



37 Teachers have enough selection input 



46.4% 
32.5% 
21.8% 



38 Peer evaluations used fomatively 




54.5% 
41.0% 
28.4% 



39 Peer evaluations used summatively 



51.1% 
41.7% 



40 Staff cooperation encouraged 









nil Ill iiiiiii 







48.1% 
31.8% 
20.2% 
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Table 8 (Continued) 



PERCENTAGE AGREE 
0 10 20 30 40 50 60 70 



80 



90 



100 



Item 



CAREER LADDER PLACMENT CONCEPTS 
4 1 Fair appeal process 




58.6% 
53.1% 
45.0% 



42 Advancement criteria understood 




43 Can stay at same level 




54.4% 
49.1% 
41.3% 



51.8% 
43.1% 



44 Challenging CLP criteria 




50.9% 
35.7% 
26.6% 



45 Clear evaluation standards 

llillllllllllllllllllllllllllll 




58.2% 
51.2% 
47.0% 



46 Adequate materials assistance 




45.7% 
42.1% 
48.0% 



47 Outside advancement opportunides 

BBillB 




71.4% 
58.7% 
48.9% 
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Tables (Continued) 



PERCENTAGE AGREE 
0 10 20 30 40 50 60 70 



80 



90 100 



Item 



CAREER LADDER PLACEMENT (continued) 
48 Teachers involved in CLP development 




53.1% 
51.8% 
49.0% 



49 Net positive response for greater 




56.1% 
39.9% 
25.2% 



SO Qear personnel criteria 




35.6% 
30.9% 
26.0% 



51 Higher responsibilities appropriate 




70.7% 
53.9% 
45.6% 



52 Adequate number of trained personnel 




54.7% 
44.4% 
37.1% 



53 Adequate teacher input on revisions 



m 



50.8% 

45.8% 
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Table 9 

Response Profile of Percentage Agree with Specific 
Research Components by Hours of Inservice Development 



^^ ■ ^ ■ ^^'^^^^^^ ^ ^ -pcrc^itage agree who i^eived from 0 to 4 hours of inservice 
I 



percentage agreewho recieved 5 or more hours of inse-vice 



PERCENTAGE AGREE 
10 20 30 40 50 60 70 80 



Item 

GENERAL CAREER LADDER CONCEPTS 
14 Attracts high quality people 



15 Retain most competent teachers 



16 Will improve instruction 



17 Student piogitss improve 



ia Encourage tcicher cooperation 



19 Improve teacher morale 



20 Improve perceived professional status 
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Table 9 (Condrued) 



10 



20 



30 



PERCENTAGE AGREE 
40 50 60 70 



80 



90 



100 



Item 



GENERAL CAREER LADDER CONCEPTS (continued) 
21 Money rewards available 

\'\\'\\\\\\\\\\VVV\VV\V\\\\\'\\\\\\'\\\\\\\\\\M 



62.7% 
74.3% 



22 Intrinsic reward available 



35.8% 
!;2.0% 



23 Goals clearly conununicated 



49.1% 
60.9% 



STAFF DEVELOPMENT AND TRAINING CONCEPTS 
24 Received adequate inservice 



38.9% 
66.2% 



25 Administrators well trained 



44.6% 
63.5% 



26 Ptcr evaluators well trained 



39.9% 



27 Adequate teacher skills resources 



56.1% 
67.3% 
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Table 9 (Continued) 



10 20 30 



PERCENTAGE AGREE 
40 50 60 



70 80 90 100 



Item 



TEACHER EVALUATION SYSTEM CONCEPTS 
28 Performance levels clearly defined 



56.3% 



29 Administrators evaluate fairly 



58.2% 
70.7% 



30 Consistent evaluation procedures 



40.3% 
56.0% 



31 Evaluation time sufficient 



44.7% 
60.9% 



32 Time worth benefits gained 



33.3% 
56.4% 



33 CoiTCCt achievement emphasis 



X\\\\XV\\X\\ 



62.8% 



34 Student outcomes reflect performance 



31.6% 
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Table 9 (Continued) 



10 



20 30 



PERCENTAGE AGREE 
40 50 60 



70 80 90 100 



Item 



PEER EVALUATION CONCEPTS 
35 Chosen for top performance 



35.9% 



36 Well trained evaluators 



47.1% 
67.0% 



37 Teachers have enough selection input 



38.9% 
31.7% 



38 Peer evaluation used formatively 



39.6% 
55.6% 



39 Peer evaluation used summacively 



45.4% 



40 Staff cooperation encouraged 



SI 



31.0% 
56.0% 
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Table 9 (Continued) 



10 20 30 



PERCENTAGE AGREE 
40 50 60 



70 80 90 100 



Item 

CAREER LADDER PLACEMENT CONCEPTS 



41 Fair appeal process 



50.9% 



42 Advancement criteria understood 



48.2% 
58.2% 



43 Can stay at same level 



51.9% 
63.7% 



44 Challenging CLP criteria 



36.3% 
53.2% 



45 Qear evaluation standards 



\\\\\\\\\\\\\'\\\\^ 



56.1% 



46 Adequate materials assistance 



47 Outside advancement opportuniies 
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Table 9 (Connnued) 



10 20 



30 



PERCENTAGE AGREE 
40 50 60 70 



80 90 100 



Item 

CAREER LADDER PLACEMENT CONCEPTS (continued) 
48 Teachers involved in CLP placement 



SI. 2% 
57.8% 



49 Net positive response for greater responsiblity vs. release ame 



40.7% 
58.0% 



50 Clear personnel criteria 



29.8% 
40.1% 



51 Higher responsibilities appropriate 



56.2% 
69.0% 



52 Adequate number of trained personnel 



45.8% 
55.2% 



53 Adequate teacher input on revisions 
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Table 10 



Response Profile of Percentage Agree with Specific 
Research Components by School Level 



1 



elementary 



t ^y:^yyy| = middle school /J.H. 



80 



Item 



= high school 



PERCENTAGE AGREE 
0 10 20 30 40 50 60 70 



90 100 



GENERAL CAREER LADDER CONCEPTS 
14 Attracts high quality people 




48.6% 
49.8% 
38.0% 



IS Retain most competent people 




38.1% 
42.4% 
31.0% 



16 Will improve instruction 



50.6% 
54.7% 
44.0% 



17 Student progress improve 




44.9% 
47.4% 
38.6% 



18 Encourage teacher cooperation 
i ' \ 



L 



28.0% 
30.7% 
23.3% 



19 Improve teacher morale 
I '■ 1 



J 



22.9% 
23.5% 
19.0% 



20 Improve perceived professional status 



i 



49.2% 
51.7% 
43.9% 
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Table 10 (Continued) 



PERCENTAGE AGREE 



10 



20 



30 



40 



50 



60 



70 



80 



90 



100 



Item 



GENERAL CAREER LADDER CONCEPTS (continued) 
21 Monev rewards available 



L 



67.6% 
64.1% 
61.59: 



22 Intrinsic reward available 



I J 



42.3% 
41.6% 
33.6% 



23 Goals clearly communicated 



54.1% 
50.6% 
49.6% 



STAFF DEVELOPMENT AND TRAIMNG CONCEPTS 
24 Recieved adequate inservice 



49.2% 
42.5% 
47.0% 



25 Administrat(»s well trained 



55.4% 
47.2% 
43.5% 



26 Peer evaluators well trained 



50.7% 
38.6% 
44.4% 



27 Adequate teacher skills resources 




616% 
59.7% 
53.2% 
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Table 10 (Continued) 



10 



20 



30 



PERCENTAGE AGREE 
40 50 60 70 



Item 



80 



90 100 



TEACHER EVALUATION SYSTEM CONCEPTS 
28 PerfoniUiiice levels clearly defined 



64.3% 
57.6% 
49.4% 



29 Adntinistrators evaluate fairly 









^^^^ 


^^^^^^ 
















' 1 



66.6% 
62.1% 
51.6% 



30 Consistent evaluation procedures 



48.4% 
45.1% 
36.4% 



31 Evaluation time sufficient 




54.8% 
46.1% 
41.9% 




42.8% 
40.8% 
33.9% 



33 Correct achievement emphasis 



56.5% 
53.8% 
42.1% 



34 Student outcomes reflect performance 




39.0% 
34.5% 
28.2% 
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Table 10 (Continued) 



10 20 



30 



PERCENTAGE AGREE 
40 SO 60 



Item 



''O 



80 



90 100 



PEER EV/iLUATION CONCEPTS 
35 Chosen for top performance 



L 



47.8% 
37.1% 
32.3% 



36 Well trained evaluates 




58.4% 
46.8% 
46.4% 



37 Teachers have enough selection input 




41.2% 
37.8% 



38 Peer evaluat ons used formadvely 




52.9% 
41.0% 
34.1% 



39 Peer evaluations used summatively 







47.1% 
44.5% 
40.5% 



40 Staff cooperation encouraged 



41.0% 
36.8% 
30.2% 
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Table lO(Contiiiued) 
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PERCENTAGE AGREE 
40 50 60 70 



Item 



80 



90 



100 



CAREER LADDER PLACMENT CONCEPTS 
41 Fair appeal process 



57.8% 
54.8% 
50.8% 



42 Advancement criteria understood 



J 



53.1% 
49.6% 
47.5% 



43 Can stay at same level 



58.7% 
51.2% 
49.9% 



44 Challenging CLP criteria 



44.6% 
43.2% 
31.8% 



45 Clear evali:<ition standards 



56.7% 
53.9% 



46 Adequate materials assistance 




46.5% 
43.2% 
40.2% 




67.3% 
62.6% 
55.4% 
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Table 10 (Continued) 













PERCENTAG*: 


AGREE 










0 
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Item 



CAREER LADDER PLACEMENT (continued) 
48 Teachers involved in CLP development 



L 



56.6% 
52.8% 
45.6% 



49 Net positive response for greater 



46.9% 
49.4% 
39.3% 



50 Clear personnel criteria 



J 



35.8% 
32.2% 
27.3% 



51 Higher responsibilities appropriate 



64.8% 
57.8% 
50.2% 



52 Adequate number of traL 



.iiiel 




52.7% 
45.5% 
40.9% 



53 Adequate teacher input on revisions 



23" 



51.5% 
48.4% 
42.7% 



39 



ERIC 



-1 



Table 11 

Response Profile of Percentage Agreement 
With Specific Reasearch Components by Teacher/Administrator Comparisons 



^Teachers 



1 



Administrators 



10 



20 



30 



PERCENTAGE AGREE 

40 50 60 



70 



80 



90 100 



Item 

GENERAL CAREER LADDER CONCEPTS 



14 Attracts high quality people 



L 



45.5% 
75.8% 



IS Retain most competent teachers 



36.2% 
78.0% 



16 Will improve instruction 



L 



49.2% 
80.4% 



17 Student progress in^rove 



43.1% 



18 Encourage teacher cooperation 



L 



27.1% 
43.0% 



19 Improve teacher mora.'*. 



21., % 

37.5% 



20 Improve perceived professional status 



Al.1% 
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T:blell (Continued) 
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PERCENTAGE AGREE 
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80 90 100 



Item 

GENERAL CAREER LADDER CONCEPTS (continued) 
21 Money rewards available 



L 



65.0% 
83.7% 



22 Intrinsic reward available 



L 



39.4% 
61.5% 



23 Goals clearly communicated 



51.5% 
84.3% 



STAFF DEVELOPMENT AND TRAINING CONCEPTS 
24 Received adequate inservice 











'"mm 






1 



46.4% 
77.0% 



IS Administrators well trained 



L 



50.1% 
73.8% 



26 Peer evaluators well trained 



45.8% 



27 Adequate teacher skills resources 



59.2% 
81.4% 
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Table 11 (Continued) 



10 20 30 



PERCENTAGE AGREE 
40 5 0 60 70 



80 90 100 



Item 



TEACHER EVALUATION SYSTEM CONCEPTS 
28 Perfonnance levels dearly defined 



L 



58.7% 
81.7% 



29 Administrators evaluate fairly 



L 



61.2% 
89.0% 



I0C 



!onsistent evaluation procedures 



L 



44.1% 
72.3% 



31 Evaluation time sufficient 



49.2% 
72.3% 



32 Time worth benefits gained 



L 



39.5% 
68.2% 



33 Correct achievement emphasis 



L 



5i;89! 
75.6% 



34 Student outcomes reflect performance 



^^^^^^^^^^^^^ 



63.1% 
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Table 1 1 (Continued) 
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PERCENTAGE AGREE 
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80 90 100 
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PEER EVALUATION CONCEPTS 
35 Chosen for top perfonnance 



40.1% 
72.5% 



36 Well trained evaluators 











1 i 1 


37 Teachers have enough selection input 












1 





51.6% 



36.j^w 
67.5% 



38 Peer evaluation used formatively 



L 



44.7% 
40.5% 



39 Peer e/aluation used summatively 







w^mm 




wwmf 








1 



44.2% 
57.5% 



40 Staff cooperadon encouraged 











— 1 
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Tabic 11 (Continued) 
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Item 

CAREER LADDER PLACEMENT CONCEPTS 
41 Fair appeal process 



L 



54.4% 
85.2% 



42 Advancement criteria understood 



L 



50.6% 
70.7% 



43 Can stay at same level 



L 



54.1% 
1 93.4% 



44 Challenging CLP criteria 



L 



40.5% 
60.7% 



45 Qear evaluation standards 



L 



53.5% 
67.4% 



46 Adequate materials a^jistance 



43.7% 



47 Outside advancement opportunites 



62.6% 
90.5% 
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Table 1 1 (Continued) 
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PERCENTAGE AGREE 
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Item 



CAREER LADDER PLACEMENT CONCEPTS (continued) 
48 Teachers involved in CLP placement 



70 



80 



90 100 



51.9% 
92.8% 



M ""P""'" re.nnn..Ki.>. vs. release 



ume 




44.6% 
78.8% 



50 Gear personnel criteria 




32.0% 
53.3% 



51 Higher responsibiUties appropriate 




59.2% 
84.4% 



52 Adequate number of trained penonnel 




75.6% 



53 Adequate teacher input on revisions 




47.3% 
90.9% 
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Table 12 

Organizational Climate Subscales Stratified within Selected Demographic Characteristics 









Teach. 


Peer 


CLP 








Gen. 


Staff 


Eval. 


Eval. 


Con. 


Clim. 


Grand 




Mean 


Mean 


Mean 


Mean 


Mean 


Mean 


Mean 




Teachers/ applied for CLP 


2.724 


3.258 


3.301 


4.049 


3.234 


3.129 


3.262 


Teachers / did not apply for CLP 


2.077 


3.106 


2.911 


3.677 


2.933 


3.021 


2.928 


Teachers / already placed on CLP 


2.744 


3.178 


3.010 


4.177 


2.978 


3.036 


3.179 


1-7 years teaching experience 


2.641 


3.281 


3.230 


4.139 


3.198 


3.098 


3.240 


8-25 years teaching experience 


2.355 


3.099 


2.946 


3.841 


2.939 


3.034 


3.016 


Over 25 years teaching experience 


2.226 


3.148 


2.996 


3.461 


2.905 


2.970 


2.934 


Teachers 


2.424 


3.154 


3.035 


3.915 


3.021 


3.038 


3.076 


Administrators 


2.985 


3.344 


3.238 


4.158 


3.264 


3.587 


3.417 


Elemeantary 


2.489 


3.231 


3.103 


4.093 


3.101 


3.118 


3.170 


Secondary 


2.428 


3.101 


3.004 


3.740 


2.957 


2.998 


3.015 


Composite Means 


2.465 


3.173 


3.057 


3.937 


3.037 


3.065 


3.102 


Pooled Across Demographics 

















MEAN - Range = 1 .000 - 4.000 Values from 1 .000 - 2.500 = Generally Negati .-e 

Values from 2.501 - 4.000 = Generally Positive 
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Table 13 

Educator Perceptions of Organizational Climate Items 
by Percentage Agreement and Total means 
for 1986, 1987 Data Cycles 



SURVEY STATEMENT 




PERCENT AGREE 


PERCENT DISAGREE 


MEAN 
SCORE 





Climate Perceptions 

Belonging 

Successful 

Being Rewarded 

Work Has Clear Purpose 

Job Has functional Importance 

Cooperative Work Environment 

Good Leadership Models 

Free From Excessive Stress 

Goals Communicated 

Get Progress Feedback 

Secure in Job Status 

Strong Social Network 

Communication Level Feels Good 



n86 1987 
SA 



1986 1987 
MA 



Composite Climate 



40.3 
55.0 
19.3 
53.4 
56.0 
40.8 
30.8 
12.2 
24.5 



37.8 
54.3 
20.6 
58.6 
50.8 
40.4 
34.0 
12.2 
24.4 
17.9 
50.5 
22.9 
20.7 



42.2 
35.5 
39.2 
36.5 
33.6 
43.0 
43.3 
31.3 
47.2 



36.6 
33.5 
38.4 
29.6 
35.6 
39.0 
37.5 
28.8 
43.9 
41.4 
33.1 
40.1 
40.3 



1986 1987 
MD 



10.8 
5.9 
24.7 
6.5 
7.0 
11.0 
15.9 
27.0 
20.0 



11.0 
4.9 
22.0 
5.7 
6.6 
10.8 
15.8 
27.8 
19.6 
24.6 
8.0 
22.1 
23.4 



1986 1987 
SD 



6.8 
3.6 
16.9 
3.5 
3.4 
5.2 
10.1 
29.4 
8.3 



10.3 
4.0 
15.5 
2.9 
3.4 
6.2 
8.8 
28.0 
8.1 
10.9 
5.2 
10.4 
12.0 



1986 1987 



3.159 
3.419 
2.608 
3.398 
3.422 
3.194 
2.948 
2.264 
2.879 



3.144 
3.481 
2.748 
3.536 
3.444 
3.243 
3.086 
2.346 
2.967 
2.818 
3.385 
2.888 
2.809 



3.032 3.069 



CODE: 

SA = Strongly Agree MA = Moderately Agree 
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SD = Strongly Disagree 



EXHIBIT A 



— » ' BMMfdi & Evaluation Proj«a • C«mc. ior Excalbnca in Education • Northam Anzona Universny 



Dear Professional Educator 

The Arizona Caieer Ladder Research and Evaluation Center has been assigned the 
task of conductinQ research regarding the success of approved districts in the development 
of their urique career ladder pilot programs. We are very pleased to be able io do this, 
partlcularty since the State Legislature has allowed time to detennine the kinds of models 
which work we!! in attracting, retaining and motivating high quality professwnals. 

We need your help in detennining how you see various aspects of your district's 
career ladder plan. You will be asked to f^o this only once a yeari 1 he results will be used for 
the purpose of assisting your district in improving its program and for the Research Center to 
report on the results of the Arizona Pitot Career Ladder Project to the Joint Legislative 
Conunittee on Career Ladders. 

Your response is ennfidpntial and your school and district name win not be used in 
reporting the findings. Please return this survey to the person designated by your district's 
career ladder coordinator as stated on the cover instmctnn sheet. 

Rease view this survey as an opportunity to express your perceptions in a confidential 
manner. It is not necessary to respond to any questions which make you feel 
uncomfortable, but remember that your percepttons counti 



YOUR PEOCEPnONS ARE JUST AS VALUABLE WHETHER OR NOT YOU 
INTEND TO PARTICIPATE IN THE CAREER LADDER OPTION 



THANK YOU! 
Sincerely, 




Or. Lawrence M. Aleamoni, Professor & 
Director of Instnjctionai Research & 
Oevelcpmsnt, U of A 




Dr. G. C. Helmstadter, Professor & 
Director of School Personnel 
Evaluation & Learning Laboratory, 
ASU 



Dr. Louann A. Bieriein 
Research Associate. 
NAU 




Dr. Richard D. Packard. Professor 
of Research. Foundations & 
Administration. NAU 



ERIC 



Dr. flichaid D. Pacxart, Manager • P. 0. Box 5774 htorthem Anzona Univarsity • Ragsaff. A2 8601 

^ 



• 



All School Dl^tet CTt;?lrji»«d Prsennel 



INSTRUCnONS: Fir«t place the ood« for your school on the answer shMt M^irt >^Urt Qpft ftnm Pf^ QUftstton which 
best de6crit>es you or your posnion and fill in the correct location on the answer sheet. Please respond to tne tiAfo sections 
which relate to your positicrt. 

A. District and School Coda ( find correct cods from cover sheet and place in first four spaces of box labeled SSSI^ 
Sec-jntv Numbgf on answer sheet). 



1 . School Level at which you primarily work: 



A) Benientary 

2. Position in District: 

A) ClassHMm Teacher 

B) Lbrarian 

3. Gender (optional): 
A) Female 

4. Ethnidty (optional): 

A) Anglo 

B) Hispanic 

5. Degree: 

A) Bachelors 

B) Bachelors > 



B) Middle/Junior High School; C) High School 



D) DMA 



C) Counsebr 

D) Other Resource Personnel 



B) Male 



C) Native American 

D) Black 



C) Masters 

D) Mastam^ 



E) Building Level Administrator 
P) Central Office Administrator 



E) Asian 

F) Other 



E) Doctorate 



Hours of district inservice received on the entire Career Ladder Prnnr^m (e.g., evaluatbn instrument, aiteria 
(EEi), procedures, portfolio development, CLP placement, crrteria for upward mobility, etc.) 

A) 0 hours C) 5-8 hours E) 13 or more hours 

B) 1-4 hours D) 9-12 hours 



Teaehera & Other tngtruetlonal Personnel only (Admin tatrators please skip to #12) 

7. Number of years total as a tear^er in tha orefession ! 

A) 1-3 years C) 8-lS years E) Over 25 years 

B) 4-7 years D) 16-25 years 

8. I have been placed on my districfs CLP. 

A) Yes B) No C) No CLP Placement has occurred 

9. If you have not done so already, in the future do you intend to apply for the career ladder program: 

A) Yes B) No C) DNA since already applied to CLP 

1 0. Number of formal & infn''mal evaluation observations received this school year for the Career Ladder Program: 

A) 0 C) 4-6 D) 10 or more 

B) 1-3 D) 7-9 E) DNA -too early in CLP 

1 1 . Who conducted your Ca^»y Ladde>' evaluation observations this school year? 

A) Building admin, only C) Building + Central aomin. only E) Other combination 

B) Building admin peer evaluators I , Buiiding -f Central aomin. peer evaiuators F) DNA- too earty in CLP 

Adminlgtratofa Suoervlsorg. etc.. onlv 

12. Number of years in distnct as an administrator 

A) Under 3 years C) 8-1 5 years E) Over 25 years 

B) 3-7 years D) 16-25 years 

13. How many teachers have you been assigned to evaluate this year for the Career Ladder Program? 

A) 1-10 C) 21-30 E) 41 ornfwre 

B) 11-20 D) 31-40 F) DNA-tooea/fy inCLP 

er|c 



PERCEPTION ASSESSMENT SCALE 



Using the Rating Scale shown below, please choose the response which best describes the way YOU feel 
about the concept expressed by each statement. Please respond to each statement in relation to ma 
rarppf Ladder Prooram in vour sofictfic dljitrirt not c ^ff iaHHor d««;trirt?^ in neneral. Indcate your 
selection by filling in the appropriate space on the answer sheet. 

Please darken tnese letters with a #2 pencil on the answer sheet to reflect your 
perceptions: 

patlnq Scale 

A s Strongly Agree C s Moderately Disagree 

B m Moderately Agree D s Strongly Disagree 

E s Does Not Apply or Too earfy In CLP 



A. Qpnprai Camer Ladder Concepts: 

1 4. The Career Ladder Program (CLP) will attract high quality 

people into the teaching profession ^ ^ ^ ^ 

15. The Career Ladder Program (CLP) will retain the most 

competent teachers in the dassroom *^ ^ ^ ^ ^ 

1 6. The Career Ladder Program (CLP) w;n i prove instruction A B C D E 

17. The Career Ladder Program (CLP) will improve student 

academic progress, ^ ^ ^ ^ ^ 

18. The CLP encourages cooperation among teachers A B C D E 

19. The CLP will improve teacher morale ^ ^ ^ ^ ^ 

20. The CLP will improve the professional status of teachers in the 

eyes of the public ^ ^ ^ ° ^ 

21 . Monetary rewanis available through the CLP are viewed as a 



significant incentive ^ 



B C D E 



22. Intrinsic rewards (personal satisfaction) available through the 

CLP are viewed as a significant incentive ^ ^ ^ ^ ^ 

23. The district's career ladder goals and objectives have been 

dearty communicated to teachers ^ ^ ^ ^ ^ 

B. Staff Development and Training Concepts 

24. I have received adequate inservice on the CLP teacher 

evaluatbn system. ^ ^ ^ ° ^ 

25. Administrators are well trained in the CLP evaluation system A B C D E 

25. PeorEvaluatorsare well trained in the CLP evaluation system (if used) A B C D E 

27. The district provides adequate resources to t»elp teachers 

gain the skills required for advancement on the ladder. A B C D 



28. The evaluation instruments clearty define 

the various leveis of teaching performance A B C D E 

29. I feel that administraiors evaluate teaching performance 

fairly for placement on the ladder A B C D E 

30. The CLP evaluation procedures are structured in such a manner 

to insure consistency among evaluaiors A B C D E 

31. The amount of time evaluators spend observing teachers is 

sufficient to en*ujre proper placements on the ladder. A B C D E 

32. Time required for the CLP evaluation process is worth the 

benefits gained A B C D E 

33. An appropriate amount of enphasis is placed on student 

achievement and i^sreiaibn to nny CLP evaluation A B C D E 

34. Student Outcomes required by the CLP are 

a good reflection of my teaching performance A B C D E 

D. PQer Evaluation Concepts (Please select (E) for Does Not apply if your district does not use peers in 

the CLP -^valuation) 

35. Peer evaluators have been selected on the basis of their superior 

qualKcatJons. A B C D E 

36. Peer evaluators are weO trained in CLP evaluation procedures A B C D E 

37. Teachers have sufficient i>.put in the selection of the peer evaluators 

involved in their evaluation. A B C D E 

38. Peer evaluation is only being used (onnativety (to assist teachers in the 

improvement of instruction) A B C D E 

39. Peer evaluation i? only being used summatively (to make decisions 

about placement in the CLP) A B C D E 

40. I believe peer evaluation ir my district encourages cooperative 

, staffeflorts. A B C D E 

E. Caragr Ladder Piaeemgnt Concgpts 

41. The CLP includes a fair appeal process for disagreements over 

placement on the ladder. A B C D E 

42. Teachers clearty understand what is expected of them in order to 

advance on the ladder A B C D 5 

43. Teachers can feel comfortable about choosing to remain at 

the same level on tf>e ladder. A B C D E 

44. The criteria for career ladder levels are challenging enough 

so that only the most competent teachers advance A B C D E 
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• 45. The CLP dearty specifies standards for jiidging the oomen^ 

maerial submitted for CLP evabaton(port^ A B C D E 

46. Ar^equate assistance is being provided to teachers regarding 

the deveiopnriem d rruKterials subrnitted for CLP evai^^ A B C D E 

47. Our CLP provides teachers with opportunities for continued 

advancement without leaving the dassroom on a fulMime basis. A B C D E 

48. Teachers are adequately involved in the development of the 

dstrict career ladder program. A B C D E 

49. The positive effects of higher level responsibilities (teacher mentor, 
etc.) outweigh the possible disadvantages of being released part- 
time from classroom assignments A B C D E 

50. Clear criteria for CLP participation have been established for 
personnel whose job description differs from a regular classroom 

teacher. A B C D E 

51 . Higher level responsibiPrties in the CLP are appropriate assignments 

for those teachers selected for advancemert. A B C D E 

52. The district has an adequate number of trained personnel to 

effectively place candidates on the career ladder. A B C D E 

53. The district has estabRshed a means for adequate teacher 

input concerning possbie revisions. A B C D E 

F. Qreanizational Climate Survev The following questions are designed to assess teacher perceptions of 
general organizational climate. 

54. IhaveafeeDngof bebnging. A B C D E 

55. I have feelings of being successful in my job assignment A B C D E 

56. Ihaveafeefingof being rewarded for a job well done A B C D E 

57. I feel my work has a dear purpose A B C D E 

58. I am consistently provided knowledge of progress A B C D E 

59. I am provided a cooperative working environmenL A B C D E 

60. I am provided good leadership models. A B C D E 

61. I work in an environment free Jrom excessive stress A B C D E 

62. Ifeelrnyjob hasfuncttonaiirTponancetotheorganiza^ A B C D E 

63. I feel secure about my job status A B C D E 

64. Organizational goals are clearty corrinunicated A B C D E 

65. I feel there is a strong sodal network in my organization A BODE 

66. I feel good aboirt the comnunication level in my organization A B C D E 
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RECaUEST FOR WRrrrei COUMBITS 
^ P1««M rMpond to th« following op«n-9nd«d quMtont in t^fOCM to your distncL B#cauM th« rssponsM to 
th6S« quMtbns will tabulctMi Mparit«fty. pb«M pfovid« th« following dMK)graphic mformcton onc« agam. 

1. Namt of District School Cod«_ 

Z Aim yo^ on ttm CIP Of V loo •mffH>r your dimi^ fym) (no) pNA- Admin.) 

3. YMf»ofs«rvic#lnt««*ingpfof#a»ion: (1-3) (4^7) (8-15) (1&-25) (ow25) 

A. Pleas« describe the maior streoqthfs^o f your district career ladder prograra 



B. Please describe the area(s) of your career ladder program which r\^ed improvement. 



C, District: Please describe the area(s) of your Districts 0fn; ^ni7??tfQnal Climate which are the 
strongest and those areas which need improvement 



D, School: Please describe the ar8a(s) of your S^irhoofs Orr ^n^r^tu-inai Clinnste which are the 
strongest and those areas which need improvement 



